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Abstract 

It  is  well-known  that  the  dominating  paradigm  of  the  robustness  re¬ 
search  is  the  so-called  worst-case  model.  In  contrast  to  this  model,  the 
main  feature  of  the  approach  studied  in  this  paper  is  to  provide  a  proba¬ 
bilistic  assessment  on  the  system  robustness. 

We  present  here  an  overview  of  this  research  area,  usually  denoted  as 
“probabilistic  methods  for  analysis  and  control  of  uncertain  systems.” 


1  Introduction 

The  modern  approach  for  robustness  of  control  systems  is  mainly  focused  on 
a  deterministic  description  of  the  uncertainty.  Along  this  line  of  research,  fun¬ 
damental  results  have  been  obtained  in  the  last  twenty  years,  see  for  instance 
[6], [9], [40]  and  references  therein.  The  main  drawback  of  this  approach,  however, 
lies  in  the  computational  complexity  limitations  arising  in  a  number  of  problems, 
as  pointed  out  in  several  recent  papers  on  NP-hardness  in  system  and  control, 
see  e.g.  [7], [8], [28].  This  issue  forces  the  control  engineer  to  introduce  simplifica¬ 
tions  and  overbounding  in  the  description  of  the  uncertainty,  in  order  to  obtain 
a  relaxed  problem  that  is  easier  to  deal  with.  In  this  way,  one  trades  tightness  in 
the  problem  description  with  computational  efficiency. 

The  study  of  probabilistic  methods  for  analysis  and  design  of  control  systems 
has  recently  received  a  growing  interest  in  the  scientific  community.  Probabilistic 
and  randomized  techniques  provide  complementary  methodologies  for  studying 
robustness,  with  a  trade-off  between  computational  complexity  and  tightness  of 
the  solution  [13], [15], [31], [41],  The  starting  point  of  the  randomized  approach 

*A  version  of  this  paper  has  been  published  in  Perspectives  in  Robust  Control  -  Lecture 
Notes  in  Control  and  Information  Science ,  (ed.  S.O.  Moheimani),  Springer- Ver lag. 
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is  to  introduce  a  probabilistic  description  of  the  unknown-but-bounded  uncer¬ 
tainty.  Unlike  classical  worst-case  methods,  randomized  algorithms  provide  a 
probabilistic  assessment  on  the  satisfaction  of  design  specifications.  Besides  their 
low  complexity,  a  fundamental  advantage  of  these  algorithms  resides  in  the  fact 
that  the  obtained  robustness  margins  are  larger  than  the  classical  ones,  if  a  pre¬ 
specified  level  of  risk  is  accepted  [12].  Probabilistic  algorithms  can  therefore  be 
used  by  the  control  engineer,  together  with  classical  robustness  methods,  in  order 
to  obtain  useful  additional  information  on  the  problem. 


Figure  1:  M-A  configuration. 

In  this  paper,  which  is  a  revised  and  updated  version  of  [38],  we  present  a 
review  of  recent  results  on  the  probabilistic  approach  for  robustness  analysis  and 
design  of  uncertain  systems.  In  Section  2,  we  introduce  definitions  and  notation. 
In  Section  3,  we  derive  explicit  bounds  for  the  number  of  samples  required  to 
estimate,  within  a  given  level  of  accuracy  and  confidence,  the  probability  that  a 
control  system  subject  to  random  uncertainty  A,  with  given  probability  density 
function  (pdf)  over  a  set  Ap,  attains  a  specified  performance  level  7.  It  can  be 
easily  shown  that  the  number  N  of  randomly  generated  samples  is  independent  of 
the  number  of  blocks  (either  real,  complex  or  mixed)  of  the  matrix  A  and  the  size 
of  the  set  Ap.  This  fact  is  an  immediate  consequence  of  the  Law  of  Large  Numbers 
and  is  often  used  in  Monte  Carlo  simulations,  see  [22], [36], [37].  Subsequently,  in 
Section  4,  the  problem  of  sample  generation  is  outlined,  and  algorithms  for  the 
generation  of  random  samples  uniformly  distributed  in  various  norm-bounded 
sets  are  discussed.  In  Section  5,  we  show  how  probabilistic  robust  design  can  be 
performed  in  this  framework.  I11  particular,  we  discuss  iterative  algorithms  for 
the  design  of  Linear  Quadratic  Regulators  that  guarantee  robustness  properties 
in  terms  of  probability.  Conclusions  are  briefly  summarized  in  Section  6. 

2  Preliminaries 

In  this  paper,  we  use  the  standard  M-A  configuration  adopted  in  worst-case  ro¬ 
bustness  methods;  see  e.g.  [40]  for  a  more  general  discussion  on  this  topic.  In 
Figure  1,  M(s)  represents  the  deterministic  part  of  the  system,  which  consists  of 
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the  nominal  plant  and  controller  transfer  matrices  and  weighting  functions,  while 
A  is  used  to  describe  various  perturbations  affecting  the  control  system.  Distur¬ 
bances  and  errors  are  denoted  by  d  and  e,  respectively.  The  class  of  allowable 
perturbations  is  defined  as 

A  =  {blockdiag  [qilri, qiln,  Ai, . . . ,  A6]}. 

The  vector  q  =  [qi,  q2, . . . ,  qf\T  G  takes  into  account  real  or  complex  parametric 
uncertainties  affecting  the  plant,  while  the  matrices  A*  G  i  =  1 

are  full  block  matrices  generally  introduced  to  represent  high  order  unmodeled 
dynamics.  The  structured  matrix  A  is  restricted  within  a  set  Ap  described  in 
terms  of  norm-bounded  balls  of  radius  p 

Ap  =  {A  G  A  :  \\q\\  <  p,  ||A;||  <  p,  i  =  1, . . . ,  b}  . 

In  the  standard  /i-theory  setting  [18], [35],  the  induced  f?2-norm 

II A||2  =  sup  || Ax||2 
||x|[2=l 

is  used,  even  though  definitions  of  /i  based  on  the  Frobenius-norm  have  been  also 
studied  [23].  The  choice  of  the  £2-norm  is  clearly  equivalent  to  take  ||g||oo  and 
||  Aj||2,  i  =  1, . . . ,  b.  We  remark  that,  depending  on  the  specific  problem  under  at¬ 
tention,  different  £p  norms  may  be  chosen  to  describe  parametric  uncertainty.  For 
example,  one  can  choose  £2  and  £±  norm  balls  as  bounding  sets  for  the  uncertainty 
vector  q\  see  e.g.  [3]. 

In  the  classical  problem  of  robustness  analysis  of  the  control  system  shown 
in  Figure  1,  the  goal  is  to  guarantee  that  a  certain  performance  requirement  is 
attained  for  all  A  G  Ap.  In  general,  this  requirement  can  be  stated  in  terms  of 
the  performance  function 

u  =  u(  A), 

where  u( A)  is  a  Lebesgue  measurable  function  of  A.  Without  loss  of  generality, 
in  this  paper  we  study  a  single  performance  function,  but  in  general  the  simulta¬ 
neous  attainment  of  several  performance  requirements  may  be  handled  with  the 
techniques  presented  here. 

A  classical  example  of  performance  function  deals  with  the  Tioo  norm  of  a 
stable  transfer  function  matrix  T^e(M,  A)  between  the  disturbances  d  and  the 
error  e.  That  is,  we  set 

M(A)  =  ||Tde(M,A)||0O, 

and  check,  for  a  given  performance  level  7,  if  u( A)  <  7  for  all  A  G  Ap. 

Another  example  of  performance  function  is  related  to  robust  stability  of  a 
continuous  time  MIMO  system.  To  illustrate,  consider  a  state-space  realization 
of  M,  i.e. 

M(s)  =  C(sl  -  A)~1B  +  D, 
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with  A  E  Mri,Tl  stable  and  B,  C,  D  real  matrices  of  suitable  dimensions.  Then,  if 
the  well-posedness  condition  on  D  holds  [33],  we  obtain 

{A  :  A  +  BA(I  -  DA)~lC  stable}  =  (A  :  det(J  -  A M(ju))  ^  0,  Vo ;  e  R}. 

The  performance  function  u( A)  for  robust  stability  of  the  M- A  configuration  is 
therefore  given  by 

u( A)  =  max(Re  Ai(A),  Re  A2(A), . . . ,  Re  A„(A)) 

where  Ai(A), . . . ,  An(A)  are  the  eigenvalues  of  the  uncertain  matrix  A  +  BA(I  — 
DA)~1C.  In  this  case,  clearly,  robust  stability  is  guaranteed  if 
maxAeAp  w(A)  <  0. 

Further  examples  of  performance  functions,  which  include  sensitivity  mini¬ 
mization,  disturbance  attenuation  and  tracking,  are  described  for  instance  in  [40] . 
In  general,  robustness  analysis  is  equivalent  to  one  of  the  following  two  formula¬ 
tions 

Performance  Verification  Problem 

For  a  given  performance  level  7  >  0,  check  whether 

u( A)  <  7 


for  all  A  E  Ap. 

Worst-Case  Performance  Problem 

Find  Umax  such  that 

■Umax  =  max  m(A). 

AeAp 

As  previously  pointed  out,  the  drawbacks  of  this  worst-case  problem  formula¬ 
tion  are  computational  complexity  and  conservatism.  These  issues  recently  led  to 
the  formulation  of  a  probabilistic  approach,  which  is  outlined  in  the  next  section. 

3  Probabilistic  Robustness  Analysis 

Consider  the  performance  verification  problem  discussed  in  the  previous  section 
and  define  the  two  sets 


A  good  =  (A  e  Ap  :  u(  A)  <  7}; 

Abad  =  (A  G  Ap  :  u( A)  >  7}. 

Robust  performance  is  attained  for  all  A  in  the  set  A good,  while  it  is  violated  if 
A  E  Abad ■  The  union  of  A good  and  Abad  obviously  coincides  with  the  uncertainty 
set  Ap.  Therefore,  the  volume 

vol(A90od)  =  /  dA 

Agood 
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can  be  taken  as  a  measure  of  the  system  robustness.  We  observe  that  in  classical 
robustness  analysis,  one  of  the  objectives  is  to  compute  the  value  of  7  such  that 
performance  is  guaranteed  for  all  A  €  Ap.  This  is  equivalent  to  require  that  the 
set  A g00d  coincides  with  Ap.  On  the  other  hand,  in  a  probabilistic  setting,  we  are 
satisfied  if  these  two  sets  “approximately”  coincide  and,  in  particular,  the  ratio 

VOl(A good)  x 

vol(Ap)  1  J 


is  close  to  one. 

Next,  we  assume  that  the  structured  matrix  A  is  a  random  matrix  with  asso¬ 
ciated  probability  density  function  /a (A)  and  support  Ap.  Formally,  for  a  given 
set  S  C  Ap,  we  define 


ProbjA  G  S}  =  /  /A(A)dA. 

is 

The  probabilistic  robustness  of  the  M- A  system  is  therefore  stated  in  terms  of 
the  probability  that  the  system  satisfies  the  desired  perfomance.  In  other  words, 
if  A  is  a  random  matrix,  we  aim  to  compute  the  “weighted”  volume  of  the  set 
A g00d  with  respect  to  the  density  function  /a  (A) 

ProbjA  G  Agood}  =  f  /a(A)(2A  =  Prob  (w(A)  <  7}. 

J  A  good. 

Clearly,  if  /a  (A)  is  the  uniform  density  on  Ap,  the  probability  Prob{A  G  Agood} 
coincides  with  the  ratio,  defined  in  (1),  of  the  volumes  vol(A300(i)  and  vol(Ap). 
We  remark  that  the  choice  of  uniform  distribution  is  common  in  this  setting  for 
its  worst-case  properties  in  a  certain  class  of  distribution  functions  [4]. 

3.1  Performance  Verification  Problem 

We  now  study  the  probabilistic  version  of  the  performance  verification  problem. 
Given  a  performance  level  7  >  0,  we  aim  to  estimate  the  probability  of  perfor¬ 
mance 

p7  =  Prob  {u( A)  <  7}.  (2) 

The  exact  computation  of  this  probability  is  in  general  very  difficult,  and  only  in 
very  special  cases  can  be  computed  in  closed  form,  see  e.g.  [19].  More  generally,  p7 
may  be  estimated  by  means  of  a  randomized  algorithm.  To  this  end,  we  generate 
N  independent  identically  distributed  (i.i.d.)  samples  within  Ap 

A1,A2,...,Ajvg  Ap 

according  to  the  given  density  function  /A (A).  Subsequently,  we  compute 

m(A1),m(A2),  . . . ,  ^(A^) 
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and  we  construct  the  indicator  function 


/(A*) 


1  if  u( A*)  <  7; 
0  otherwise. 


An  estimate  of  p7  is  immediately  obtained  as 

1  N 

P"  =  ]v£/(a,> 

2=1 


which  is  equivalent  to 


Pn 


Ngood 

N 


where  Ngood  is  the  number  of  samples  such  that  u{ A*)  <  7.  The  estimate  p n  is 
usually  referred  to  as  empirical  probability. 

Clearly,  for  a  finite  sample  size,  it  is  important  to  know  how  many  samples  are 
needed  to  obtain  a  reliable  estimate  Pn  of  p7.  This  reliability  can  be  measured 
in  terms  of  the  “closeness”  of  Pn  to  the  probability  p1.  That  is,  given  e  G  (0, 1), 
we  impose 

K  -pN I  =  |Prob{n(A)  <  7}  -  Pn\  <  e. 


Since  Pn  is  estimated  via  random  sampling,  we  notice  that  it  is  a  random  variable. 
Therefore,  for  given  6  G  (0, 1),  we  require 


Prob{|p7  —  Pn |  <  e}  >  1  —  h.  (3) 

The  problem  is  then  hireling  the  minimal  N  such  that  (3)  is  satisfied  for  fixed 
accuracy  e  G  (0, 1)  and  confidence  5  G  (0, 1).  An  immediate  solution  of  this  prob¬ 
lem  is  given  by  the  Bernoulli  Law  of  Large  Numbers  [5]. 


Bernoulli  Law  of  Large  Numbers 

For  any  e  G  (0, 1)  and  S  G  (0, 1),  if 


then 

Prob{|p7  —  Pn  |  <  e}  >  1  —  <5. 

The  derivation  of  this  bound  is  very  simple  and  it  is  based  upon  the  Chebychev 
inequality  [29].  We  observe  that  the  number  of  samples  computed  with  the  Law 
of  Large  Numbers  is  independent  of  the  number  of  blocks  of  A,  the  size  of  Ap  and 
the  density  function  /a (A).  Unfortunately,  the  number  of  samples  N  may  be  very 
large.  For  example,  if  e  =  0.1%  and  1  —  S  =  99.9%,  we  obtain  N  =  2.5  •  108.  We 
remark,  however,  that  the  cost  associated  with  the  evaluation  of  u{ A*)  for  fixed 
A*  is  polynomial-time  in  many  cases.  This  is  true  when  dealing,  for  example,  with 
the  computation  of  Fioo  norms  or  when  stability  tests  are  of  concern.  Therefore, 
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on  the  contrary  of  the  worst-case  robustness  approach  (see  the  discussion  in 
Section  1),  we  conclude  that  the  total  cost  to  perform  probabilistic  performance 
analysis  is  polynomial-time,  provided  that  polynomial-time  algorithms  for  sample 
generation  are  available.  This  latter  problem  is  addressed  in  Section  3. 

A  bound  which  improves  upon  the  previous  one  is  the  Chernoff  Bound  [16]. 

Chernoff  Bound 

For  any  e  G  (0, 1)  and  5  G  (0, 1),  if 


N  > 


lQgf 

2e2 


then 

Prob{|p7  —  Pn\  F  e}  >  1  —  5. 

We  remark  that  the  Chernoff  Bound  largely  improves  upon  the  bound  of 
Bernoulli.  For  example,  if  e  =  0.1%  and  1  —  6  =  99.9%,  we  compute  N  =  3.9- 106. 

Finally,  we  observe  that  these  bounds  can  be  computed  a  priori  and  are 
explicit.  That  is,  given  e  and  5  one  can  find  directly  the  minimum  value  of  N. 
On  the  other  hand,  when  computing  the  classical  lower  and  upper  confidence 
intervals,  the  sample  size  obtained  is  not  explicit.  More  precisely,  for  given  6  G 
(0, 1),  the  so-called  lower  and  upper  confidence  intervals  pl  and  pu  are  such  that 

ProbjpL  <  p-y  <  pu}  =  1  —  5. 

The  evaluation  of  this  probability  requires  the  solution  with  respect  to  Pl  and  pu 
of  equations  of  the  type 


N 

E 

k - Ngood 


?v» 


Pl)"-*  =  5l; 


Ng°od 

E  (kJPH*  i1  -  Ph)"-*  = 

with  5l  +  Su  —  S.  Clearly,  the  probabilities  pl  and  pu  can  be  computed  only  a 
posteriori ,  once  the  value  of  Ngood  is  known.  Moreover,  since  an  explicit  solution 
of  the  previous  equations  is  not  available,  standard  tables  are  generally  used;  see 
e.g.  [20]  and  [34], 

3.2  Worst-Case  Performance  Problem 

When  dealing  with  the  worst-case  performance  problem,  we  look  for  a  probabilis¬ 
tic  estimate  of 

■Umax  =  max  u( A). 

AeA  p 
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Figure  2:  Comparison  between  Chernoff  and  worst-case  bounds 


To  this  end,  we  adopt  again  a  random  sampling  scheme,  as  in  the  performance 
verification  problem,  generating  N  i.i.d.  samples  within  Ap.  Consequently,  we 
obtain 

Un  =  max  u(  A*). 

For  this  special  formulation  of  the  probabilistic  robustness  problem,  a  bound  on 
the  sample  size  N  is  given  in  [22]  and  [37]. 


Bound  for  worst-case  performance 

For  any  e  G  (0, 1)  and  S  G  (0, 1),  if 


N  > 


lQgj 

l°gl^ 


(4) 


then 

Prob{Prob{w(A)  >  uN}  <  e}  >  1  —  5.  (5) 

In  [15]  the  bound  (4)  is  shown  to  be  tight  if  the  distribution  function  of  A  is 
continuous. 

We  remark  that  the  worst-case  performance  problem  is  a  special  case  of  the 
general  empirical  probability  estimation  discussed  in  the  previous  subsection.  In 
fact,  setting  7  =  uN  in  (2)  we  obtain 


and 


=  Prob  ('u(A)  <  u at}  =  1  —  Prob  {w( A)  >  uN} 


Pn 


A good 

N 


1. 
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Therefore,  equation  (3)  becomes 

Prob{|p7  —  Pn\  <  e}  =  Prob{Prob{w(A)  >  uN}  <  e}. 

Comparing  the  bonnd  (4)  with  the  Cher noff  bound,  it  can  be  immediately  verified 
that  the  number  of  samples  required  for  the  worst-case  performance  problem 
is  much  smaller  than  that  needed  for  the  performance  verification  problem;  see 
Figure  2.  However,  there  is  no  guarantee  that  un  is  actually  close  to  the  maximum 
Umax'  As  shown  in  Figure  3,  the  bound  previously  discussed  only  guarantees  that 
the  set  of  points  greater  than  the  estimated  value  has  a  measure  smaller  than  e 
and  this  is  true  with  a  probability  at  least  1  —  5.  In  turn,  this  implies  that  if  the 
function  u( A)  is  sufficiently  smooth,  the  estimated  and  actual  maximum  may  be 
close. 

In  [2]  a  similar  problem,  with  only  one  level  of  probability,  instead  of  the  two 
probability  levels  studied  in  this  section,  is  considered.  However,  in  this  case,  the 
sample  size  may  be  an  exponential  function  of  the  number  of  uncertainties  and 
therefore  computational  complexity  becomes  a  critical  issue.  Finally,  we  recall 
that  many  results  on  sample  complexity,  based  on  the  introduction  of  powerful 
concepts  like  VC-dimension  (a  measure  of  the  problem  complexity),  may  be  found 
in  [39];  see  also  [24]  for  some  recent  results. 

4  Sample  Generation  Problem 

As  discussed  in  the  previous  section,  a  problem  which  is  critical  in  the  proba¬ 
bilistic  setting  is  the  development  of  efficient  algorithms  for  sample  generation  in 
various  sets  according  to  several  distributions.  The  interested  reader  may  refer 
to  [17]  and  [27]  for  a  general  discussion  on  the  topic  of  random  number  gener¬ 
ation.  In  particular,  in  [17]  several  algorithms  for  univariate  sample  generation 
according  to  various  distributions  are  shown,  while  in  [27]  Monte  Carlo  and  Quasi- 
Monte  Carlo  methods  are  analyzed  in  details.  However,  no  specific  algorithm  for 
vector  and  matrix  sample  generation  within  sets  of  interest  in  robust  control  is 
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provided  in  the  Monte  Carlo  literature.  We  also  remark  that  standard  rejection 
methods  cannot  be  used  for  their  inefficiency,  see  details  in  [13].  In  the  context  of 
uncertain  control  systems  described  in  the  M- A  form,  the  problem  is  the  sample 
generation  within  Ap  according  to  a  given  density  function  /a- 

For  real  and  complex  parametric  uncertainties  qi,  q2,  ■  ■  ■ ,  qe,  bounded  in  the 
£p  norm-ball  of  radius  p 

#f(/0  =  {q  e  F£  :  ||g||p  <  p)  ,  (6) 

the  sample  generation  problem  has  a  simple  solution.  We  report  here  an  algo¬ 
rithm,  presented  in  [10],  that  returns  a  real  random  vector  q  uniformly  distributed 
in  the  norm-ball  B^(p).  This  algorithm  is  based  on  the  so-called  Generalized 
Gamma  density  Ga,c(x),  defined  as 

Ga,c(x )  =  Y^—rXca~1e~xC,  x  >  0, 

r(a) 

where  a  and  c  are  given  parameters  and  T(a)  is  the  Gamma  function. 

Algorithm  for  uniform  sample  generation  in  Bu(p) 

1 .  Generate  £  independent  random  real  scalars  distributed  according 

to  Gi  (x). 

2.  Construct  the  random  vector  i  £  K(  of  components  x% 
are  independent  random  signs.  The  random  vector  y- 
ly  distributed  on  the  boundary  of  Rg  (p) . 

3.  Generate  z  =  w1^ ,  where  to  is  a  random  variable  uniformly  distribu¬ 
ted  in  [0,1].  Return  q  =  pzy . 

Figure  4  visualizes  the  main  steps  of  this  algorithm  in  the  simple  case  of  sample 
generation  of  two  dimensional  real  vectors  in  a  circle  of  radius  one  (£  —  2,  p  —  2, 

p  —  1).  First,  we  notice  that  for  p  =  2  the  Generalized  Gamma  density  Gi  (x) 

p 

is  related  to  the  Gaussian  density  function.  The  random  samples  drawn  from  a 
Gaussian  distribution  (step  1)  are  radially  symmetric  with  respect  to  the  £ 2  norm. 
Roughly  speaking,  this  means  that  their  level  curves  are  f^-spheres.  Secondly, 
the  samples  are  normalized  obtaining  random  vectors  uniformly  distributed  on 
the  boundary  of  the  circle  (step  2),  and  then  injected  according  to  the  volumetric 
factor  ^  (step  3).  We  remark  that  in  [10]  a  similar  algorithm  for  complex  vectors 
uniformly  distributed  in  the  norm-ball  £>c(p)  is  presented.  The  related  concept 
of  p-normality  is  discussed  in  [21]  and  an  algorithm  for  the  sample  generation  on 
the  boundary  of  the  £ 2  norm-ball  is  given  in  [26] 

The  sample  generation  problem  becomes  much  harder  when  we  are  interested 
in  the  uniform  generation  of  real  and  complex  matrix  samples  A  G  Fn,m  bounded 
in  the  induced  £p-norm.  In  particular,  while  the  cases  p  =  1  and  p  =  00  can  be  im¬ 
mediately  reduced  to  multiple  random  vector  generation  for  which  the  techniques 


=  s^i,  where  st 
-  jrA-  is  uniform- 
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step  1 


Gaussian  density 


■4 


step  2  step  3 


Figure  4:  Generation  of  real  random  vectors  uniformly  distributed  in  a  circle 


described  in  [11]  can  be  used,  the  solution  for  the  induced  £2-norm  ball  requires 
the  development  of  specific  methods.  In  particular,  the  algorithms  presented  in 
[13]  and  [14]  are  based  on  the  singular  value  decomposition  of  the  complex  (real) 
matrix  A  in  the  matrix  product 


A  =  UYV* 

where  U  and  V  are  unitary  (orthogonal)  matrices  and  £  is  a  diagonal  matrix 
containing  the  singular  values  of  A.  The  main  idea  is  to  compute  the  density 
functions  of  U,  £  and  V,  respectively,  such  that  the  resulting  pdf  /a (A)  is  uni¬ 
form.  This  approach  is  an  extension  of  the  methods  described  in  [1]  and  [25]  in 
the  context  of  the  theory  of  random  matrices  for  the  special  case  when  A  is  a 
real  symmetric  matrix. 


5  Probabilistic  Robust  LQ  Regulators 

In  this  section,  we  discuss  probabilistic  robust  design  of  uncertain  systems  in 
the  classical  setting  of  Linear  Quadratic  Regulators.  We  consider  a  state  space 
description  of  the  M-  A  system  given  in  Figure  1,  where  the  structured  uncertainty 
A  G  A p  enters  into  the  state  matrix  of  the  system 

x(t)  =  A(A)x(t)  +  Bu(t ),  (7) 
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with  initial  conditions  x(0)  =  xq. 

The  performance  index  is  the  standard  quadratic  cost  function 

roo 

J=  /  (xT(t)Sx(t)  +  uT  (t)Ru(t))dt 
Jo 

where  S  =  ST  >  0  and  R  =  RT  >  0  are  given  weights.  We  take  a  state  feedback 
law  of  the  form 

u(t )  =  —R~1BTQ~1x(t)  (8) 

with  Q  =  QT  >  0.  For  given  7  >  0,  it  is  well-known  that  the  LQR  problem  can 
be  reformulated  in  terms  of  the  Quadratic  Matrix  Inequality  (QMI) 

A(A)Q  +  QAt( A)  -  2 BR~lBT  +  7(QSQ  +  BR~lBT)  <  0. 

That  is,  if  a  solution  Q  =  QT  >  0  of  this  QMI  exists  for  all  A  e  Ap,  then  the 
control  law  (8)  quadratically  stabilizes  the  system  (7),  and  the  cost 

J  <  ^XqQ^Xq 

is  guaranteed  for  all  A  e  Ap,  see  e.g.  [30]. 

The  solution  given  in  [32]  is  based  on  a  sequential  algorithm.  At  each  step  of 
the  sequence,  the  algorithm  is  based  upon  two  stages 

•  Generation  of  a  random  sample  Ak  of  the  uncertainty  A  e  Ap. 

•  Subgradient  computation  for  the  convex  constraint  defined  by  the  QMI  for 

Ak. 

The  first  stage  depends  on  the  specific  uncertainty  structure  under  attention 
and  can  be  performed  using  the  methods  described  in  Section  4.  The  outcome 
of  this  stage  is  a  random  sample  Ak  e  Ap.  The  second  stage  requires  finding 
an  “approximate  solution1'  of  a  convex  constraint  defined  by  the  guaranteed  cost 
problem.  This  can  be  immediately  performed  by  subgradient  step  and  projection 
on  a  cone  of  nonnegative  definite  matrices.  The  outcome  of  this  stage  is  to  obtain 

Qk. 

In  [32],  under  fairly  mild  assumptions,  it  is  shown  that  this  sequential  algo¬ 
rithm  provides  a  controller  which  guarantees  a  given  cost  with  probability  one 
in  a  finite  number  of  steps.  In  addition,  at  a  fixed  step  k,  a  lower  bound  of  the 
probability  that  a  quadratically  stabilizing  controller  is  found  is  also  computed. 
One  of  the  advantages  of  this  solution  is  that  very  general  uncertainty  structures 
can  be  easily  handled.  For  example,  when  dealing  with  quadratic  stability  of 
an  uncertain  system  affected  by  structured  or  nonlinear  parametric  uncertainty, 
standard  methods  based  011  Linear  Matrix  Inequalities  (LMI)  [9]  cannot  be  used 
without  introducing  overbounding.  In  addition,  even  if  this  conservatism  is  ac¬ 
ceptable,  the  LMI  solution  generally  requires  to  simultaneously  solve  a  number  of 
convex  inequalities  which  is  exponential  in  the  number  of  parameters.  Unless  the 


3  - 12 


RTO-EN-SCI-142 


An  Overview  on  Randomized 
Algorithms  for  Analysis  and  Control  of  Uncertain  Systems 


problem  size  is  very  small,  this  issue  is  computationally  critical  so  that  finding 
a  feasible  solution  with  standard  interior  point  methods  may  be  very  difficult 
or  even  intractable.  On  the  other  hand,  the  solution  discussed  here  deals  with 
only  one  constraint  at  each  step  of  the  sequence  and  therefore  computational 
complexity  is  not  an  issue. 


6  Conclusion 

This  paper  is  focused  on  nonstandard  tools  for  analysis  and  control  of  uncertain 
systems,  with  emphasis  on  the  interplay  of  probability  and  robustness.  The 
goal  is  to  combine  hard  bounds,  which  are  frequently  used  in  classical  robust 
control,  with  probabilistic  information  which  is  often  neglected  in  this  context. 
The  main  advantage  is  to  provide  additional  insight  to  the  control  engineer.  This 
insight  may  be  very  useful  in  analyzing  and  designing  uncertain  control  systems. 
We  believe  that  future  research  will  be  mainly  directed  towards  the  syntesis 
of  probabilistic  robust  controllers  for  output  feedback  and  the  development  of 
probabilistic  optimization  algorithms. 
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